CE-GAN: Community Evolutionary Generative Adversarial Network for Alzheimer's Disease Risk Prediction.

In the studies of neurodegenerative diseases such as Alzheimer's Disease (AD), researchers often focus on the associations among multi-omics pathogeny based on imaging genetics data. However, current studies overlook the communities in brain networks, leading to inaccurate models of disease development. This paper explores the developmental patterns of AD from the perspective of community evolution. We first establish a mathematical model to describe functional degeneration in the brain as the community evolution driven by entropy information propagation. Next, we propose an interpretable Community Evolutionary Generative Adversarial Network (CE-GAN) to predict disease risk. In the generator of CE-GAN, community evolutionary convolutions are designed to capture the evolutionary patterns of AD. The experiments are conducted using functional magnetic resonance imaging (fMRI) data and single nucleotide polymorphism (SNP) data. CE-GAN achieves 91.67% accuracy and 91.83% area under curve (AUC) in AD risk prediction tasks, surpassing advanced methods on the same dataset. In addition, we validated the effectiveness of CE-GAN for pathogeny extraction. The source code of this work is available at https://github.com/fmri123456/CE-GAN.

Species -shared and -unique gyral peaks on human and macaque brains.

Cortical folding is an important feature of primate brains that plays a crucial role in various cognitive and behavioral processes. Extensive research has revealed both similarities and differences in folding morphology and brain function among primates including macaque and human. The folding morphology is the basis of brain function, making cross-species studies on folding morphology important for understanding brain function and species evolution. However, prior studies on cross-species folding morphology mainly focused on partial regions of the cortex instead of the entire brain. Previously, our research defined a whole-brain landmark based on folding morphology: the gyral peak. It was found to exist stably across individuals and ages in both human and macaque brains. Shared and unique gyral peaks in human and macaque are identified in this study, and their similarities and differences in spatial distribution, anatomical morphology, and functional connectivity were also dicussed.

Task sub-type states decoding via group deep bidirectional recurrent neural network.

Decoding brain states under different cognitive tasks from functional magnetic resonance imaging (fMRI) data has attracted great attention in the neuroimaging filed. However, the well-known temporal dependency in fMRI sequences has not been fully exploited in existing studies, due to the limited temporal-modeling capacity of the backbone machine learning algorithms and rigid training sample organization strategies upon which the brain decoding methods are built. To address these limitations, we propose a novel method for fine-grain brain state decoding, namely, group deep bidirectional recurrent neural network (Group-DBRNN) model. We first propose a training sample organization strategy that consists of a group-task sample generation module and a multiple-scale random fragment strategy (MRFS) module to collect training samples that contain rich task-relevant brain activity contrast (i.e., the comparison of neural activity patterns between different tasks) and maintain the temporal dependency. We then develop a novel decoding model by replacing the unidirectional RNNs that are widely used in existing brain state decoding studies with bidirectional stacked RNNs to better capture the temporal dependency, and by introducing a multi-task interaction layer (MTIL) module to effectively model the task-relevant brain activity contrast. Our experimental results on the Human Connectome Project task fMRI dataset (7 tasks consisting of 23 task sub-type states) show that the proposed model achieves an average decoding accuracy of 94.7% over the 23 fine-grain sub-type states. Meanwhile, our extensive interpretations of the intermediate features learned in the proposed model via visualizations and quantitative assessments of their discriminability and inter-subject alignment evidence that the proposed model can effectively capture the temporal dependency and task-relevant contrast.

Hierarchical functional differences between gyri and sulci at different scales.

Gyri and sulci are 2 fundamental cortical folding patterns of the human brain. Recent studies have suggested that gyri and sulci may play different functional roles given their structural and functional heterogeneity. However, our understanding of the functional differences between gyri and sulci remains limited due to several factors. Firstly, previous studies have typically focused on either the spatial or temporal domain, neglecting the inherently spatiotemporal nature of brain functions. Secondly, analyses have often been restricted to either local or global scales, leaving the question of hierarchical functional differences unresolved. Lastly, there has been a lack of appropriate analytical tools for interpreting the hierarchical spatiotemporal features that could provide insights into these differences. To overcome these limitations, in this paper, we proposed a novel hierarchical interpretable autoencoder (HIAE) to explore the hierarchical functional difference between gyri and sulci. Central to our approach is its capability to extract hierarchical features via a deep convolutional autoencoder and then to map these features into an embedding vector using a carefully designed feature interpreter. This process transforms the features into interpretable spatiotemporal patterns, which are pivotal in investigating the functional disparities between gyri and sulci. We evaluate the proposed framework on Human Connectome Project task functional magnetic resonance imaging dataset. The experiments demonstrate that the HIAE model can effectively extract and interpret hierarchical spatiotemporal features that are neuroscientifically meaningful. The analyses based on the interpreted features suggest that gyri are more globally activated, whereas sulci are more locally activated, demonstrating a distinct transition in activation patterns as the scale shifts from local to global. Overall, our study provides novel insights into the brain's anatomy-function relationship.

The concentration of dissolved organic matter impacts the neurobehavior in female zebrafish exposed to cyclophosphamide.

Cyclophosphamide (CP) is a broad-spectrum anticancer drug for various cancers and frequently detected in aquatic environments, reaching concentrations up to 22 µg/L. However, there is limited understanding of the toxicities of CP with the presence of dissolved organic matter, a ubiquitous component in aquatic environments, in fish. In this study, we investigated the behaviors, morphological alterations of retina, and related gene transcripts in zebrafish exposed to CP (0 and 50 µg/L) and Humic acid (HA, a main component of DOM) at concentrations of 0, 3, 10, and 30 mg-C/L for 30 days. The results showed that, relative to the zebrafish in CP treatment, HA at 30 mg-C/L increased the locomotion (12.1 % in the light and 7.2 % in the dark) and startle response (9.7 %), while inhibiting the anxiety (12.5 %) and cognition of female zebrafish (24.6 %). The levels of transcripts of neurotransmitter- (tph1b and ache), neuroinflammation-(il-6 and tnfα) and antioxidant-(gpx) related genes in the brain of female adult were also altered by CP with the presence of HA. In addition, HA promoted the transgenerational effects of CP on the neurobehaviors. Therefore, HA can enhance potential neurotoxicity of CP in female fish through alteration neurotransmission related genes. Our findings provide new insights into the toxicity and underlying mechanisms of CP with the presence of dissolved organic matter, thereby contribute to a deeper understanding of the risks posed by CP in aquatic ecosystems.

Technical note: Generalizable and promptable artificial intelligence model to augment clinical delineation in radiation oncology.

BACKGROUND: Efficient and accurate delineation of organs at risk (OARs) is a critical procedure for treatment planning and dose evaluation. Deep learning-based auto-segmentation of OARs has shown promising results and is increasingly being used in radiation therapy. However, existing deep learning-based auto-segmentation approaches face two challenges in clinical practice: generalizability and human-AI interaction. A generalizable and promptable auto-segmentation model, which segments OARs of multiple disease sites simultaneously and supports on-the-fly human-AI interaction, can significantly enhance the efficiency of radiation therapy treatment planning. PURPOSE: Meta's segment anything model (SAM) was proposed as a generalizable and promptable model for next-generation natural image segmentation. We further evaluated the performance of SAM in radiotherapy segmentation. METHODS: Computed tomography (CT) images of clinical cases from four disease sites at our institute were collected: prostate, lung, gastrointestinal, and head & neck. For each case, we selected the OARs important in radiotherapy treatment planning. We then compared both the Dice coefficients and Jaccard indices derived from three distinct methods: manual delineation (ground truth), automatic segmentation using SAM's 'segment anything' mode, and automatic segmentation using SAM's 'box prompt' mode that implements manual interaction via live prompts during segmentation. RESULTS: Our results indicate that SAM's segment anything mode can achieve clinically acceptable segmentation results in most OARs with Dice scores higher than 0.7. SAM's box prompt mode further improves Dice scores by 0.1∼0.5. Similar results were observed for Jaccard indices. The results show that SAM performs better for prostate and lung, but worse for gastrointestinal and head & neck. When considering the size of organs and the distinctiveness of their boundaries, SAM shows better performance for large organs with distinct boundaries, such as lung and liver, and worse for smaller organs with less distinct boundaries, like parotid and cochlea. CONCLUSIONS: Our results demonstrate SAM's robust generalizability with consistent accuracy in automatic segmentation for radiotherapy. Furthermore, the advanced box-prompt method enables the users to augment auto-segmentation interactively and dynamically, leading to patient-specific auto-segmentation in radiation therapy. SAM's generalizability across different disease sites and different modalities makes it feasible to develop a generic auto-segmentation model in radiotherapy.

Exploring Alzheimer's disease: a comprehensive brain connectome-based survey.

Dementia is an escalating global health challenge, with Alzheimer's disease (AD) at its forefront. Substantial evidence highlights the accumulation of AD-related pathological proteins in specific brain regions and their subsequent dissemination throughout the broader area along the brain network, leading to disruptions in both individual brain regions and their interconnections. Although a comprehensive understanding of the neurodegeneration-brain network link is lacking, it is undeniable that brain networks play a pivotal role in the development and progression of AD. To thoroughly elucidate the intricate network of elements and connections constituting the human brain, the concept of the brain connectome was introduced. Research based on the connectome holds immense potential for revealing the mechanisms underlying disease development, and it has become a prominent topic that has attracted the attention of numerous researchers. In this review, we aim to systematically summarize studies on brain networks within the context of AD, critically analyze the strengths and weaknesses of existing methodologies, and offer novel perspectives and insights, intending to serve as inspiration for future research.

Mapping dynamic spatial patterns of brain function with spatial-wise attention.

Objective: Using functional magnetic resonance imaging (fMRI) and deep learning to discover the spatial pattern of brain function, or functional brain networks (FBNs) has been attracted many reseachers. Most existing works focus on static FBNs or dynamic functional connectivity among fixed spatial network nodes, but ignore the potential dynamic/time-varying characteristics of the spatial networks themselves. And most of works based on the assumption of linearity and independence, that oversimplify the relationship between blood-oxygen level dependence signal changes and the heterogeneity of neuronal activity within voxels.Approach: To overcome these problems, we proposed a novel spatial-wise attention (SA) based method called Spatial and Channel-wise Attention Autoencoder (SCAAE) to discover the dynamic FBNs without the assumptions of linearity or independence. The core idea of SCAAE is to apply the SA to generate FBNs directly, relying solely on the spatial information present in fMRI volumes. Specifically, we trained the SCAAE in a self-supervised manner, using the autoencoder to guide the SA to focus on the activation regions. Experimental results show that the SA can generate multiple meaningful FBNs at each fMRI time point, which spatial similarity are close to the FBNs derived by known classical methods, such as independent component analysis.Main results: To validate the generalization of the method, we evaluate the approach on HCP-rest, HCP-task and ADHD-200 dataset. The results demonstrate that SA mechanism can be used to discover time-varying FBNs, and the identified dynamic FBNs over time clearly show the process of time-varying spatial patterns fading in and out.Significance: Thus we provide a novel method to understand human brain better. Code is available athttps://github.com/WhatAboutMyStar/SCAAE.

Brain Structural Connectivity Guided Vision Transformers for Identification of Functional Connectivity Characteristics in Preterm Neonates.

Preterm birth is the leading cause of death in children under five years old, and is associated with a wide sequence of complications in both short and long term. In view of rapid neurodevelopment during the neonatal period, preterm neonates may exhibit considerable functional alterations compared to term ones. However, the identified functional alterations in previous studies merely achieve moderate classification performance, while more accurate functional characteristics with satisfying discrimination ability for better diagnosis and therapeutic treatment is underexplored. To address this problem, we propose a novel brain structural connectivity (SC) guided Vision Transformer (SCG-ViT) to identify functional connectivity (FC) differences among three neonatal groups: preterm, preterm with early postnatal experience, and term. Particularly, inspired by the neuroscience-derived information, a novel patch token of SC/FC matrix is defined, and the SC matrix is then adopted as an effective mask into the ViT model to screen out input FC patch embeddings with weaker SC, and to focus on stronger ones for better classification and identification of FC differences among the three groups. The experimental results on multi-modal MRI data of 437 neonatal brains from publicly released Developing Human Connectome Project (dHCP) demonstrate that SCG-ViT achieves superior classification ability compared to baseline models, and successfully identifies holistically different FC patterns among the three groups. Moreover, these different FCs are significantly correlated with the differential gene expressions of the three groups. In summary, SCG-ViT provides a powerfully brain-guided pipeline of adopting large-scale and data-intensive deep learning models for medical imaging-based diagnosis.

A Unified and Biologically Plausible Relational Graph Representation of Vision Transformers.

Vision transformer (ViT) and its variants have achieved remarkable success in various tasks. The key characteristic of these ViT models is to adopt different aggregation strategies of spatial patch information within the artificial neural networks (ANNs). However, there is still a key lack of unified representation of different ViT architectures for systematic understanding and assessment of model representation performance. Moreover, how those well-performing ViT ANNs are similar to real biological neural networks (BNNs) is largely unexplored. To answer these fundamental questions, we, for the first time, propose a unified and biologically plausible relational graph representation of ViT models. Specifically, the proposed relational graph representation consists of two key subgraphs: an aggregation graph and an affine graph. The former considers ViT tokens as nodes and describes their spatial interaction, while the latter regards network channels as nodes and reflects the information communication between channels. Using this unified relational graph representation, we found that: 1) model performance was closely related to graph measures; 2) the proposed relational graph representation of ViT has high similarity with real BNNs; and 3) there was a further improvement in model performance when training with a superior model to constrain the aggregation graph.

Frequency-specific functional difference between gyri and sulci in naturalistic paradigm fMRI.

Disentangling functional difference between cortical folding patterns of gyri and sulci provides novel insights into the relationship between brain structure and function. Previous studies using resting-state functional magnetic resonance imaging (rsfMRI) have revealed that sulcal signals exhibit stronger high-frequency but weaker low-frequency components compared to gyral ones, suggesting that gyri may serve as functional integration centers while sulci are segregated local processing units. In this study, we utilize naturalistic paradigm fMRI (nfMRI) to explore the functional difference between gyri and sulci as it has proven to record stronger functional integrations compared to rsfMRI. We adopt a convolutional neural network (CNN) to classify gyral and sulcal fMRI signals in the whole brain (the global model) and within functional brain networks (the local models). The frequency-specific difference between gyri and sulci is then inferred from the power spectral density (PSD) profiles of the learned filters in the CNN model. Our experimental results show that nfMRI shows higher gyral-sulcal PSD contrast effect sizes in the global model compared to rsfMRI. In the local models, the effect sizes are either increased or decreased depending on frequency bands and functional complexity of the FBNs. This study highlights the advantages of nfMRI in depicting the functional difference between gyri and sulci, and provides novel insights into unraveling the relationship between brain structure and function.

RBCK1 overexpression is associated with immune cell infiltration and poor prognosis in hepatocellular carcinoma.

RBCK1 is an important E3 ubiquitin ligase, which plays an important role in many major diseases. However, the function and mechanism of RBCK1 in pan-cancer and its association with immune cell infiltration have not been reported. The purpose of this study is to find out the expression of RBCK1 in cancer, and to explore the relationship between RBCK1 and the prognosis of patients. Our results show that the expression of RBCK1 is up-regulated in a variety of malignant tumors, and is closely related to the prognosis of patients. Further studies have shown that RBCK1 regulates protein expression in the nucleus and plays an important role in ribosome and valine, leucine, and isoleucine degradation. Genetic variation analysis showed that RBCK1 was mainly involved in missense mutations in multiple tumors, and mutated patients showed poor prognoses. Further studies showed that RBCK1 may be interacted with proteins such as RNRPB, MCRS1, TRIB3, MKKS and ARPC3. Through protein interaction analysis, we found 43 proteins interacting with RBCK1 in liver cancer. We also analyzed immune cell infiltration and found that RBCK1 expression was positively correlated with T cells and macrophages, while it was negatively correlated with neutrophils, NK cells, and DCs in liver cancer. Finally, we confirmed experimentally that RBCK1 can significantly inhibit the apoptosis and invasion of HCC. Therefore, we speculate that RBCK1 plays an important regulatory role in the occurrence and development of HCC.

Spatial-temporal convolutional attention for discovering and characterizing functional brain networks in task fMRI.

Functional brain networks (FBNs) are spatial patterns of brain function that play a critical role in understanding human brain function. There are many proposed methods for mapping the spatial patterns of brain function, however they oversimplify the underlying assumptions of brain function and have various limitations such as linearity and independence. Additionally, current methods fail to account for the dynamic nature of FBNs, which limits their effectiveness in accurately characterizing these networks. To address these limitations, we present a novel deep learning and spatial-wise attention based model called Spatial-Temporal Convolutional Attention (STCA) to accurately model dynamic FBNs. Specifically, we train STCA in a self-supervised manner by utilizing a Convolutional Autoencoder to guide the STCA module in assigning higher attention weights to regions of functional activity. To validate the reliability of the results, we evaluate our approach on the HCP-task motor behavior dataset, the experimental results demonstrate that the STCA derived FBNs have higher spatial similarity with the templates and that the spatial similarity between the templates and the FBNs derived by STCA fluctuates with the task design over time, suggesting that STCA can reflect the dynamic changes of brain function, providing a powerful tool to better understand human brain function. Code is available at https://github.com/SNNUBIAI/STCAE.

Accuracy meets simplicity: A constitutive model for heterogenous brain tissue.

We present a general, hyperelastic, stretch-based potential that shows promise for modeling the mechanics of brain tissue. A specific four-parameter model derived from this general potential outperforms alternative models, such as the modified Ogden model, the Gent model, Demiray model, and machine-learning models, in capturing brain tissue elasticity. Specifically, the stretch-based model achieved R2 values of 0.997, 0.992, and 0.993 (tension, compression, and shear) for the cortex, 0.995, 0.983, and 0.983 for the basal ganglia, 0.994, 0.929, and 0.970 for the corona radiata, and 0.990, 0.896, and 0.969 for the corpus callosum. This work has the potential to advance our understanding of brain tissue mechanics and provides a valuable tool to improve finite element models for the investigation of brain development, injuries, and disease.

Regularity and variability of functional brain connectivity characteristics between gyri and sulci under naturalistic stimulus.

The human cerebral cortex is folded into two fundamentally anatomical units: gyri and sulci. Previous studies have demonstrated the genetical, structural, and functional differences between gyri and sulci, providing a unique perspective for revealing the relationship among brain function, cognition, and behavior. While previous studies mainly focus on the functional differences between gyri and sulci under resting or task-evoked state, such characteristics under naturalistic stimulus (NS) which reflects real-world dynamic environments are largely unknown. To address this question, this study systematically investigates spatio-temporal functional connectivity (FC) characteristics between gyri and sulci under NS using a spatio-temporal graph convolutional network model. Based on the public Human Connectome Project dataset of 174 subjects with four different runs of both movie-watching NS and resting state 7T functional MRI data, we successfully identify unique FC features under NS, which are mainly involved in visual, auditory, emotional and cognitive control, and achieve high discriminative accuracy 93.06 % to resting state. Moreover, gyral regions as well as gyro-gyral connections consistently participate more as functional information exchange hubs than sulcal ones among these networks. This study provides novel insights into the functional brain mechanism under NS and lays a solid foundation for accurately mapping the brain anatomy-function relationship.

Structure Mapping Generative Adversarial Network for Multi-View Information Mapping Pattern Mining.

Multi-view learning is dedicated to integrating information from different views and improving the generalization performance of models. However, in most current works, learning under different views has significant independency, overlooking common information mapping patterns that exist between these views. This paper proposes a Structure Mapping Generative adversarial network (SM-GAN) framework, which utilizes the consistency and complementarity of multi-view data from the innovative perspective of information mapping. Specifically, based on network-structured multi-view data, a structural information mapping model is proposed to capture hierarchical interaction patterns among views. Subsequently, three different types of graph convolutional operations are designed in SM-GAN based on the model. Compared with regular GAN, we add a structural information mapping module between the encoder and decoder wthin the generator, completing the structural information mapping from the micro-view to the macro-view. This paper conducted sufficient validation experiments using public imaging genetics data in Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. It is shown that SM-GAN outperforms baseline and advanced methods in multi-label classification and evolution prediction tasks.

Species -Shared and -Unique Gyral Peaks on Human and Macaque Brains.

Cortical folding is an important feature of primate brains that plays a crucial role in various cognitive and behavioral processes. Extensive research has revealed both similarities and differences in folding morphology and brain function among primates including macaque and human. The folding morphology is the basis of brain function, making cross-species studies on folding morphology important for understanding brain function and species evolution. However, prior studies on cross-species folding morphology mainly focused on partial regions of the cortex instead of the entire brain. Previously, we defined a whole-brain landmark based on folding morphology: the gyral peak. It was found to exist stably across individuals and ages in both human and macaque brains. In this study, we identified shared and unique gyral peaks in human and macaque, and investigated the similarities and differences in the spatial distribution, anatomical morphology, and functional connectivity of them.

Beam mask and sliding window-facilitated deep learning-based accurate and efficient dose prediction for pencil beam scanning proton therapy.

BACKGROUND: Accurate and efficient dose calculation is essential for on-line adaptive planning in proton therapy. Deep learning (DL) has shown promising dose prediction results in photon therapy. However, there is a scarcity of DL-based dose prediction methods specifically designed for proton therapy. Successful dose prediction method for proton therapy should account for more challenging dose prediction problems in pencil beam scanning proton therapy (PBSPT) due to its sensitivity to heterogeneities. PURPOSE: To develop a DL-based PBSPT dose prediction workflow with high accuracy and balanced complexity to support on-line adaptive proton therapy clinical decision and subsequent replanning. METHODS: PBSPT plans of 103 prostate cancer patients (93 for training and the other 10 for independent testing) and 83 lung cancer patients (73 for training and the other 10 for independent testing) previously treated at our institution were included in the study, each with computed tomography scans (CTs), structure sets, and plan doses calculated by the in-house developed Monte-Carlo dose engine (considered as the ground truth in the model training and testing). For the ablation study, we designed three experiments corresponding to the following three methods: (1) Experiment 1, the conventional region of interest (ROI) (composed of targets and organs-at-risk [OARs]) method. (2) Experiment 2, the beam mask (generated by raytracing of proton beams) method to improve proton dose prediction. (3) Experiment 3, the sliding window method for the model to focus on local details to further improve proton dose prediction. A fully connected 3D-Unet was adopted as the backbone. Dose volume histogram (DVH) indices, 3D Gamma passing rates with a criterion of 3%/3 mm/10%, and dice coefficients for the structures enclosed by the iso-dose lines between the predicted and the ground truth doses were used as the evaluation metrics. The calculation time for each proton dose prediction was recorded to evaluate the method's efficiency. RESULTS: Compared to the conventional ROI method, the beam mask method improved the agreement of DVH indices for both targets and OARs and the sliding window method further improved the agreement of the DVH indices (for lung cancer, CTV D98 absolute deviation: 0.74 ± 0.18 vs. 0.57 ± 0.21 vs. 0.54 ± 0.15 Gy[RBE], ROI vs. beam mask vs. sliding window methods, respectively). For the 3D Gamma passing rates in the target, OARs, and BODY (outside target and OARs), the beam mask method improved the passing rates in these regions and the sliding window method further improved them (for prostate cancer, targets: 96.93% ± 0.53% vs. 98.88% ± 0.49% vs. 99.97% ± 0.07%, BODY: 86.88% ± 0.74% vs. 93.21% ± 0.56% vs. 95.17% ± 0.59%). A similar trend was also observed for the dice coefficients. This trend was especially remarkable for relatively low prescription isodose lines (for lung cancer, 10% isodose line dice: 0.871 ± 0.027 vs. 0.911 ± 0.023 vs. 0.927 ± 0.017). The dose predictions for all the testing cases were completed within 0.25 s. CONCLUSIONS: An accurate and efficient deep learning-augmented proton dose prediction framework has been developed for PBSPT, which can predict accurate dose distributions not only inside but also outside ROI efficiently. The framework can potentially further reduce the initial planning and adaptive replanning workload in PBSPT.

Disease2Vec: Encoding Alzheimer's progression via disease embedding tree.

For decades, a variety of predictive approaches have been proposed and evaluated in terms of their prediction capability for Alzheimer's Disease (AD) and its precursor - mild cognitive impairment (MCI). Most of them focused on prediction or identification of statistical differences among different clinical groups or phases, especially in the context of binary or multi-class classification. The continuous nature of AD development and transition states between successive AD related stages have been typically overlooked. Though a few progression models of AD have been studied recently, they were mainly designed to determine and compare the order of specific biomarkers. How to effectively predict the individual patient's status within a wide spectrum of continuous AD progression has been largely understudied. In this work, we developed a novel learning-based embedding framework to encode the intrinsic relations among AD related clinical stages by a set of meaningful embedding vectors in the latent space (Disease2Vec). We named this process as disease embedding. By Disease2Vec, our framework generates a disease embedding tree (DETree) which effectively represents different clinical stages as a tree trajectory reflecting AD progression and thus can be used to predict clinical status by projecting individuals onto this continuous trajectory. Through this model, DETree can not only perform efficient and accurate prediction for patients at any stages of AD development (across five fine-grained clinical groups instead of typical two groups), but also provide richer status information by examining the projecting locations within a wide and continuous AD progression process. (Code will be available: https://github.com/qidianzl/Disease2Vec.).

MEET: A Multi-Band EEG Transformer for Brain States Decoding.

OBJECTIVE: Electroencephalography (EEG) is among the most widely used and inexpensive neuroimaging techniques. Compared to the CNN or RNN based models, Transformer can better capture the temporal information in EEG signals and focus more on global features of the brain's functional activities. Importantly, according to the multiscale nature of EEG signals, it is crucial to consider the multi-band concept into the design of EEG Transformer architecture. METHODS: We propose a novel Multi-band EEG Transformer (MEET) to represent and analyze the multiscale temporal time series of human brain EEG signals. MEET mainly includes three parts: 1) transform the EEG signals into multi-band images, and preserve the 3D spatial information between electrodes; 2) design a Band Attention Block to compute the attention maps of the stacked multi-band images and infer the fused feature maps; 3) apply the Temporal Self-Attention and Spatial Self-Attention modules to extract the spatiotemporal features for the characterization and differentiation of multi-frame dynamic brain states. RESULTS: The experimental results show that: 1) MEET outperforms state-of-the-art methods on multiple open EEG datasets (SEED, SEED-IV, WM) for brain states classification; 2) MEET demonstrates that 5-bands fusion is the best integration strategy; and 3) MEET identifies interpretable brain attention regions. SIGNIFICANCE: MEET is an interpretable and universal model based on the multiband-multiscale characteristics of EEG. CONCLUSION: The innovative combination of band attention and temporal/spatial self-attention mechanisms in MEET achieves promising data-driven learning of the temporal dependencies and spatial relationships of EEG signals across the entire brain in a holistic and comprehensive fashion.